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Assessing the Benefit-Risk for 
New Drugs 

Are the FDA's Endocrinologic and Metabolic Drugs Advisory 
Committee and the Division of Metabolism and Endocrinology 
Products in sync? 



The U.S. Food and Drug Administra- 
tion (FDA) regulates which drugs 
can be marketed in the U . S . as well as 
their label requirements. A congressio- 
nally authorized advisory committee pro- 
cess allows the FDA to receive input from 
outside experts on important regulatory 
decisions (1). Further, the advisory com- 
mittee process enhances transparency by 
allowing the public, including health care 
professionals, to understand the issues 
being considered. The Endocrinologic 
and Metabolic Drugs Advisory Commit- 
tee (EMDAC) "reviews and evaluates data 
concerning the safety and effectiveness of 
marketed and investigational human 
drug products for use in the treatment 
of endocrine and metabolic disorders, 
and makes appropriate recommendations 
to the Commissioner of Food and Drugs" 
(2). Operationally, the FDA's Division of 
Metabolism and Endocrinology Products 
(DMEP) is responsible for the review of 
most drugs used for indications relevant 
to endocrinologists and coordinates the 
EMDAC's meetings. 

In recent years, the EMDAC has been 
asked to review a number of controversial 
drugs, particularly those for the treatment 
of diabetes and obesity. Often the assess- 
ment of these drugs requires integration 
of preclinical and clinical data to 
formulate a benefit-risk assessment. The 
assessment of benefit-risk for drugs is 
increasingly recognized to be a challeng- 
ing task, and formal tools have been 
proposed to make this process more 
effective (3-7). In contrast with the 
DMEP and other FDA staff, most EMDAC 
members will have limited experience in 
these types of integrative, complex evalu- 
ations. Further, EMDAC members will 
spend considerably less time evaluating 
the available data in comparison with 
DMEP staff. Thus, it seems important to 
compare the recommendations made by 
EMDAC with the subsequent marketing 
and label decisions to assess concordance 



between the evaluative approaches used 
by EMDAC and that of DMEP (DMEP will 
be used as shorthand for the full FDA's 
involvement in regulatory decisions). 

At most of the EMDAC meetings, the 
committee is asked to vote on a benefit- 
risk recommendation or other specific 
questions. These votes reflect the best 
overall EMDAC position on the issue and 
are widely cited in the press as the meet- 
ing's primary outcome. This interpreta- 
tion is overly simplistic as the committee's 
discussions and rationales for its votes 
may be highly informative to DMEP de- 
liberations and have greater importance 
than the votes (8). Nonetheless, the vote 
represents the consensus of the commit- 
tee members' deliberations and opinions, 
as well as their integration of the totality of 
the information into an overall benefit- 
risk calculus. 

To assess the concordance of EMDAC 
votes and subsequent actions, all EMDAC 
meetings from 1 January 2009 through 3 1 
December 2012 were reviewed. Only the 
meetings that involved the review of a 
specific drug were considered. The rec- 
ommendations of the committee were 
then compared with the actual actions 
taken with respect to marketing or label- 
ing. EMDAC recommendations were con- 
sidered concordant with subsequent 
actions when a majority of the EMDAC 
members' votes reflected the ultimate 
action. 

EMDAC met to discuss specific drugs 
20 times during the period of interest 
(Table 1). In only 12 (60%) of these cases 
was the ultimate action concordant with 
the EMDAC vote. In two cases, concor- 
dance could not be assessed because of 
the complexity of the questions or actions 
considered. In two cases where lack of 
concordance was identified, a change in 
one vote would have resulted in a major- 
ity agreement with the action. In most 
cases of EMDAC-DMEP discordance, 
EMDAC members seemed to view the 



benefit-risk of the candidate more favor- 
ably. In the examples for miglustat, 
naltrexone/bupropion, and insulin deglu- 
dec, clear majorities of EMDAC members 
favored approval while the FDA did not 
agree. In the case of sibutramine, a ma- 
jority of EMDAC members did not sup- 
port withdrawal from the market, but 
the drug was withdrawn soon after the 
meeting. In contrast, in the case of 
liraglutide, a majority of the EMDAC 
members did not support approval, but 
the drug was approved 9 months after the 
meeting. 

Importantly, lack of concordance 
between the EMDAC members and sub- 
sequent actions should not be interpreted 
as either EMDAC or FDA action being 
correct or incorrect. In fact, the action 
taken may be in full agreement with key 
points elicited during the committee's 
discussions but not in the polling of the 
individual members. Alternatively, the 
FDA's decision may have reflected con- 
siderations or data not available to the 
committee at the time of the vote. For 
example, if committee members indicated 
that certain additional information would 
change their votes, and this information is 
available to the FDA, the FDA's action 
may be concordant with the committee's 
recommendations but not their dichoto- 
mous vote. Rather, the relatively low de- 
gree of concordance should be viewed as 
reinforcing the challenges faced by the 
EMDAC. The discordance also raises the 
question as to whether EMDAC members 
are prepared to make a "yes" or "no" vote 
on issues as complex as benefit-risk as- 
sessment based on only a few hours of 
readings and deliberations. Discordance 
also suggests that the weighting of bene- 
fits and risks by committee members may 
differ from those of the DMEP and/or that 
they are being incompletely communi- 
cated during the meeting. 

The challenges the EMDAC faces in 
its deliberations are also illustrated in 
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Table I— Meetings of the EMDAC, 2009-2012 













EMDAC-DMEP 


Drug 


Meeting date 


Voting question 


Vote results 


Subsequent action 


agreement 


Saxagliptin 


1 April 2009 


CV safety 


Yes-10 
No-2 


Approval 31 July 
2009 


Yes 


Liraglutide 


2 April 2009 


Marketing 

recommendation 
given C-cell tumor 
data 


Yes-6 
No-6 


Approval 

25 January 2010 
with REMS 


No 


Rosuvastatin 


15 December 2009 


New indication for 


Yes-12 


Label change for 


No (label changes 






primary prevention 
based on hsCRP 


No-4 
Abstain- 1 


primary prevention 
9 February 2010 


more restrictive) 






>2 in patients with 




based on CRP >2 








LDL <130 and no 




in patients with at 








other cardiac risk 




least one additional 
CV risk factor 




Miglustat 


12 January 2010 


Approval for Niemann- 
Pick Disease Type C 


Yes-10 

No-3 


FDA requested 
additional 
information 


No 


Carglumic acid 


13 January 2010 


Approval 


Yes-12 
No-0 


Approval 

18 March 2010 


Yes 


Tesamorelin 


27 May 2010 


Approval 


Yes-16 
No-0 


Approval 

10 November 2010 


Yes 


Rosiglitazone 


13-14 July 2010 


Change in label and/ 


Decrease warnings 


New REMS including 


Not able to evaluate 






or marketing 


on label-0 


restricted access 


because of split 






approval based on 


No changes to label-3 


and requirement 


of votes 






new safety data 


Add warnings-7 
Add warnings and 

restrict use- 10 
Withdraw from 

market- 12 
Abstain — 1 


for new safety 
study 




Phentermine/ 


15 July 2010 


Approval 


Yes-6 


FDA requested 


Yes 


topiramate 






No-10 


additional 
information 












28 October 2010 




Sibutramine 


15 September 2010 


Change in label and/ 
or marketing 
approval based on 
new safety data 


No change-0 

Add boxed warning-2 

Add boxed warning 

and restrict use-6 
Withdraw from 

market-8 


Withdrawal from 
market by sponsor 
8 October 2010 


No 


Lorcaserin 


16 September 2010 


Approval 


Yes-5 
No-9 


FDA requested 
additional 
information 
23 October 2010 


Yes 


Naltrexone/ 


7 December 2010 


Approval 


Yes- 13 


FDA requested CV 


No 


bupropion 






No-7 


outcome trial 
preapproval 




Fenofibric acid 


19 May 2011 


Label change based 
on new outcome 
data 


No change— 3 
Remove indication for 

use with statin-4 
Maintain indication 

for use with statin 

and add clinical 

data-6 


Clinical data added to 
label but indication 
for use with statin 
maintained 
9 November 2011 


Yes 


Dapagliflozin 


19 July 2011 


Approval 


Yes-6 
No-9 


FDA requested 
additional 


Yes 
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Table 1 — Continued 



EMDAC-DMEP 



Drug 


Meeting date 


Voting question 


Vote results 


Subsequent action 


agreement 










information 












19 January 2012 




Ezetimibe/ 


z iNOvemDer zuii 


Approval lor 


Predialysis patients: 


Clinical data added 


Not able to evaluate 


simvastatin 




decreasing CV 


Yes- 16 


to label with 


as unclear how 






events in patients 


No-0 


statement "... 


label changes 






with chronic 


End-stage renal 


treatment effect. . . 


correspond to 






kidney disease 


disease patients: 
Yes-6 
No-10 


attenuated among 
patients on 
dialysis 

25 January 2012 


voting question 
and results 


Phentermine/ 


22 February 2012 


Approval 


Yes-20 


Approval 


Yes 


topiramate 






No-2 


17 July 2012 




Lorcaserin 


10 May 2012 


Approval 


Yes-18 

No-4 


Approval 

27 June 2012 


Yes 








A nclnin 1 
ii.UbLid.lll — 1 






Lomitapide 


17 October 2012 


Approval 


Yes-13 
No-2 


Approval 

24 December 2012 


Yes 


Mipomersen 


18 October 2012 


Approval 


Yes-9 

No-6 


Approval 


Yes 


Pasireotide 


7 November 2012 


Approval 


Yes-10 
No-0 


Approval 

17 December 2012 


Yes 


Insulin degludec 


8 November 2012 


Approval 


Yes-8 

No-4 


FDA requested 
additional 


No 



information 

8 February 2013 



Meetings were identified from www.fda.gov, and only meetings where specific drugs were discussed have been abstracted. Voting questions were identified from the 
meeting announcements and official minutes. Where there were multiple voting questions, the question felt to be central to the regulatory decision-making process is 
listed. Vote results are taken from the minutes, or, if no minutes were available, public reports of the meeting results were used. EMDAC-DMEP agreement was 
evaluated as a "Yes" if a majority of the voting members agreed with the DMEP action. CRP, C-reactive protein; CV, cardiovascular; hsCRP, high-sensitivity C-reactive 
protein; REMS, Risk Evaluation and Mitigation Strategy. 



meeting-to-meeting variability. During a 
2-day meeting (28-29 March 2012), the 
EMDAC recommended that all new 
drugs for obesity should have data avail- 
able from a cardiovascular outcomes trial 
prior to approval. Yet at the meetings 
immediately preceding (phentermine/ 
topiramate on 22 February 2012) and fol- 
lowing (lorcaserin on 10 May 2012) this 
meeting, the committee voted to approve 
drugs for obesity in the absence of these 
data. This may reflect the committee's dif- 
ferential consideration of an abstract safety 
concern (the policy vote) when compared 
with a specific potential drug whose bene- 
fits are demonstrated in clinical trials. 

It is likely that the estimated 60% 
concordance rate underestimates the chal- 
lenges as several of the drugs considered 
(for example, carglumic acid and pasiroe- 
tide) appear to have been relatively un- 
controversial, which made concordance 
likely. On the other hand, during votes 
where concordance was not achieved, the 



meeting transcripts reflect ambivalence 
among voting members on the benefit- 
risk proposition. For example, during the 
liraglutide meeting two members charac- 
terized their no votes as "wishy-washy" (9). 
These expressions of ambivalence may be 
considered by the DMEP as final FDA rec- 
ommendations are formulated. However, 
the goal of enhancing public transparency 
is impaired to the degree that ambiguity 
remains or when regulatory actions are 
taken that are superficially in conflict with 
the committee votes. 

The relatively high rate of discor- 
dance between EMDAC votes and sub- 
sequent actions suggest that the process 
should be re-evaluated and opportunities 
for optimization considered. For exam- 
ple, it has been suggested that advisory 
committees should not explicitly vote on 
questions regarding approvability (8). 
This would allow the meetings to focus 
on the key issues, permitting the FDA 
to receive the external perspectives and 



opinions it desires. Indeed, the absence 
of a vote might encourage committee 
members to more fully express the ration- 
ales for their views without the shortcut 
of the yes/no vote. While the vote may 
have value in the context of forcing a 
committee member to be explicit in their 
benefit-risk assessment, this will only 
have utility if the bases of the member's 
integrative evaluation are explicitly un- 
derstood and aligned with those used 
by the DMEP. 

Another approach to increase the 
utility of the meetings and to enhance 
transparency would be to use more 
formal benefit-risk tools. These tools 
have the potential to make explicit the 
major drivers of a drug's overall benefit 
and overall risk. Further, these tools also 
make apparent where differential assessments 
of benefits or risks exist between EMDAC 
members, DMEP staff, or the drug's 
manufacturer (5,6). These tools might allow 
focused discussion on the specific points 



care . diabe tesj oumals . org 



Diabetes Care, volume 36, July 2013 



1825 



Commentary 



where divergent opinions exist — often the 
result of differing information sources. For 
example, it is anecdotally interesting to 
note that committee members directly in- 
volved with treating the disease for which 
the drug is intended often seem to weigh the 
benefits of the proposed new drug differ- 
ently than those without direct experience 
with the patient population. In the case of 
liraglutide, the endocrinologists, consumer 
representative, and patient representative 
on the committee voted 6 yes and 2 no, 
while the nonendocrinologists voted 0 yes, 
4 no, and 1 abstention (9). 

EMDAC meetings play an important 
role in determining what therapies are 
available to practicing physicians. The 
relatively low level of concordance be- 
tween EMDAC votes and subsequent 
actions emphasizes the challenges faced 
by the committee members. The "right" 
answer may not be clear even when large 
amounts of data are available and re- 
viewed. It is critical that the EMDAC 
and the DMEP effectively communicate 
to each other and the public not only their 
overall benefit-risk assessments but the 
major contributors to the integrative as- 
sessment so that the differences in the val- 
uation of attributes can be understood. 
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